STUDENT'S t-TEST WITHOUT SYMMETRY 
CONDITIONS 



IOSIF PINELIS 



Abstract. An explicit representation of an arbitrary zero-mean distribution 
as the mixture of (at-most-)two-point zero-mean distributions is given. Based 
in this representation, tests for (i) asymmetry patterns and (ii) for location 
without symmetry conditions can be constructed. Exact inequalities implying 
conservative properties of such tests are presented. These developments extend 
results established earlier by Efron, Eaton, and Pinelis under a symmetry 
condition. 
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(1.1 



1. Introduction 
Efron J3J considered the so-called self-normalized sum 



s 



y/X't + .-.+Xl 

assuming that the AVs are any random variables (r.v.'s) satisfying the orthant 
symmetry condition: the joint distribution of r\\X\, . . . ,f] n X n is the same for any 
choice of signs 771 , . . . , T) n in the set {1,-1}, so that, in particular, each Xi is sym- 
metrically distributed). It suffices that the X^s be independent and symmetrically 
(but not necessarily identically) distributed. On the event {X\ = ■ ■ ■ = X n = 0}, 
S:=0. 

Following Efron [3], note that the conditional distribution of any symmetric 
r.v. X given \X\ is the symmetric distribution on the (at-most-)two-point set 
\X\}. Therefore, under the orthant symmetry condition, the distribution 
of S is the mixture of the distributions of the normalized Khinchin-Rademacher 
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sums eiai + • • • + e n a n , where the £j's are independent Rademacher r.v.'s, with 
P(si = 1) = P(si = — 1) = \ for all i, which are also independent of the Xj's, 
and a. L — Xi/(X 2 + • • • + X*)? , so that a\ + ■ ■ ■ + = 1 (except on the event 
{Xi = ■ • • = X n = 0}, where a\ = ■■■ = a n = 0). 

Let Z ~ N(0, 1). Let aj, . . . , a n be any real numbers such that a\-\ \-a^ = 1. 

The sharp form, 

(1.2) E/( Eiai + - + E A )^E/(2), 

of Khinchin's inequality [7j for f(x) = \x\ p was proved by Whittle (1960) ^1] for 
p ^ 3 and Haagerup (1982) g] for p ^ 2. For /(a;) = e Aa: (A > 0), inequality (JOJ) 
follows from Hoeffding (1963) 0, whence 

Ee AZ 2 , 

(1.3) P (siai + ■■■ + e n a n ^ x) < inf — r— = e"* / 2 Vx ^ 0. 

As noted by Efron, inequalities 11.2(1 and 1(1.3(1 together with the mentioned 
mixture representation imply 

(1.4) Ee A5 < Ee AZ VA ^ 
and 

(1.5) P(S > x) < e-* 2 ' 2 \/x^0. 

These results can be easily restated in terms of Student's statistic T, which is a 



monotonic function of S, as noted by Efron: T = J 2L ^- S/ \J\ — S 2 /n. 

Eaton (1970) 1 proved the Khinchin-Whittle-Haagerup inequality 1(1.2(1 for a 
much richer class of moment functions, which essentially coincides with the class J 73 
of all convex functions / with a convex second derivative /"; see Proposition A.l] 
and also ^21- Based on this extension of 1(1.2(1 . inequality ((1.3(1 was improved in 
mGHII]- In particular, Pinelis (1994) :9. obtained the following improvement of a 
conjecture by Eaton (1974) 

2e 3 

P (eiai + • • • + e n a n ^ x) < — P(Z ^ x) Vx E M. 

Thus, inequalities 1(1.4(1 and 1(1.5(1 can be improved as follows: 

(1.6) Ef(S)^Ef(Z) V/e^ 3 
and 

2e 3 

(1.7) P(S^x) < — P{Z^x) Viet. 

9 

Multivariate extensions of these results, which can be expressed in terms of Hotel- 
ling's statistic in place of Student's, were also obtained in 

It was pointed out in (UJ Theorem 2.8] that, since the normal tail decreases fast, 
inequality ((1.7(1 implies that relevant quantiles of S may exceed the corresponding 
standard normal quantiles only by a relatively small amount, so that one can use 
(ll.7|l rather efficiently to test symmetry even for non-i.i.d. observations. 

Here we shall present extensions of inequalities ((1.6|) and ((1.7|> to the case when 
the Xi's are not symmetric. (Asymptotics for large deviations of S for i.i.d. XiS 
without moment conditions was obtained recently by Jing, Shao and Zhou |S|.) 

Our basic idea is to represent any zero-mean, possibly asymmetric distribution 
as an appropriate mixture of two-point zero-mean distributions. Let us assume at 
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first that a zero- mean r.v. X has an everywhere continuous and strictly increasing 
distribution function (d.f.). Consider the truncated r.v. X a ,b '■= XI{a $C X ^ b}. 
(Here and in what follows, as usual, I{A} is the indicator of a given assertion A, 
so that I{A} = 1 if A is true and 1{A} = if A is false.) Then, for every fixed 
a G (—oo,0], the function b <— ► EX 0; fc is continuous and increasing on the interval 
[0, oo ) from EX a ,o ^ to EX a ,oo > 0. Hence, for each a 6 (— oo, 0], there exists a 
unique value b £ [0, oo) such that EX a b = 0. Similarly, for each b 6 [0, oo), there 
exists a unique value a 6 (— oo, 0] such that EX a i> = 0. That is, one has a one-to-one 
correspondence between a € (— oo, 0] and b £ [0, oo) such that EX a j, = 0. Denote 
by r := xx the reciprocating function defined on R and carrying this correspondence, 
so that 

EJO{X is between x and r(x)} = Viel; 

the function r is decreasing on R and such that r(r(x)) = i Vi £ M; moreover, 
r(0) = 0. (Clearly, r(x) — —x for all real x if the r.v. X is symmetric.) Thus, 
the set { {x,r(x)} : x £ R } of (at-most-)two-point sets constitutes a partition of 
R. Moreover, the two-point set {x, r(x)} is uniquely determined by the distance 
x — r(x)\ — \x\ + \ r(x)\ between the two points, as well as by the product \x\ |r(a;)|. 
One can see that the conditional distribution of the zero-mean r.v. X given W :— 
\X — r(X)\ (or, equivalently, Y := \X\ \r(X)\) is the uniquely determined zero-mean 
distribution on the two-point set {X, r(X)}. Thus, the distribution of the zero-mean 
r.v. X with an everywhere positive density is represented as a mixture of two-point 
zero-mean distributions. This mixture is given rather explicitly, provided that the 
distribution of r.v. X is known. 

Thus, one has generalized versions of the self-normalized sum which require 
- instead of the symmetry of independent r.v.'s Xj - only that the Xj's be zero- 
mean: 

Xi + h X n X\ + • • • + X n 

Sw ■= — , = and by \ :— t- 

y W 2 + ... + W 2 ■ or x + ... + Y *)&> 

where A > 0, 

Wi := \Xi - n{Xi)\ and Y := \X t r^X,)!, 

and the reciprocating function := is constructed as above, based on the 
distribution of Xi, for each i, so that the reciprocating functions may be different 
from one another if the JQ's are not identically distributed. On the event {Xi — 
• • ■ = X n — 0} (which is the same as either one of events {W\ = ■ ■ ■ = W n — 0} and 
{Y 1 = --- = Y n = 0}), S w ■■= and S Y ,\ ■= 0. Note that S w = S Y ,i = S when the 
Xi's are symmetric. Logan et al jHJ and Shao ^2] obtained limit theorems for the 
"symmetric" version of Sy,\ (with the reciprocating function r(x) = —x), whereas 
the Xi's did not need to be symmetric. 

These constructions can be extended to the general case of any zero-mean r.v. 
X, possibly with a d.f. which is not continuous or strictly increasing. Toward that 
end, one can use randomization (by means of a r.v. uniformly distributed in interval 
(0, 1)) to deal with the atoms of the distribution of r.v. X, and generalized inverse 
functions to deal with the intervals on which the d.f. of X is constant. 

Note that the reciprocating function r depends on the (usually unknown in sta- 
tistics) distribution of the underlying r.v. X. However, if e.g. the Xi constitute 
an i.i.d. sample, then the function G defined by l|2. 1|) can be estimated based on 
the sample, so that one can estimate the reciprocating function r. Thus, replacing 
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X\ + ■ ■ ■ + X n in the numerators of Sw and Sy,\ by Xi + ■ ■ ■ + X n — nO, one 
obtains approximate pivots to be used to construct confidence intervals or, equiv- 
alently, tests for an unknown mean 9. One can also use bootstrap to estimate the 
distributions of such pivots. 

2. Results 

Let X be a zero-mean real-valued r.v. defined on a probability space (O, E, P). 
Let 



(2.1) G(x) :- 



EX 1{X G (0, x]} ifxG[0,oo], 
E(-X)I{X G [x,0)} if x G [-oo,0]. 

Note that G(0) = 0; G is non-decreasing and right-continuous on [0, oo); and G 
is non-increasing and left-continuous on (— oo,0]; in particular, G is continuous at 
0. Moreover, the condition EX = implies that 

(2.2) G(oo) = G(-oo) = ±E|X| =: m < oo. 
Thus, G(x) G [0,m] for all x G [—00,00]. 

For h G [0,m], let 

(2.3) a;+(/i) := inf{x e [0, 00] : G{x) ^ /i}, 

(2.4) x- (h) := sup{x G [-00, 0] : G(a;) ^ h}. 

Note that x+(/i) G [0, 00) and X-(h) G (-00, 0] for all h G [0, m). 

For .t G M. and it G [0,1], define the reciprocating function of r.v. X by the 
formula 

(2.5) r(x,u):= 



x_(H(x,u)) if x G [0,oo), 
x + (H(x, u)) if .t G (— 00, 0], 



where 

(2.6) H(x,u):^ 



G(x-) + u ■ (G(x) - G(x-)) if xG [0,oo), 
G(aH-) + u ■ (G(x) - G(aH-)) ifxG(-oo,0] 



Note that i?(x, m) depends on u for a given value of x only if P(X = x) ^ 0. 

Let J7 : — > M be a r.v. uniformly distributed on the unit interval [0, 1] and 
independent of X. For a real x, let 



(2.7) f/jt := 



if P(X = x)^0, 
if P(X = x) = 0. 

Introduce the r.v.'s 

(2.8) W := \X - r(X,U x )\ and Y := \X r(X,U x )\ 

where the r.v. Ux is defined in the usual manner: Ux(u)) := L/x(w)( ti ') J for all 

Theorem 2.1. (i): TTiere exis< an event flo G S suc/i i/iai P(^o) = 1 an d 

continuous functions c: Vq — ► (— 00, 0] and d: Vo — > [0, 00) defined on the 
set Vq := {VF(tj) : w G Oo} such that d and (— c) are nondecreasing on Vq, 
and on fio one has 

{X, r(X, U x )} = {c(W),d(W)} and d(W) - c(W) = W. 
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D„ 



(2.11) <p f (v) := Ef(D v ) 



(ii) : the conditional distribution of X given W coincides with that of Dw •' 

(2.9) C(X\W) =C{D W \W), 
where, for every v £ Vo, D v is a r.v. such that 

d(v) with probability 
c(v) with probability j^yp^yj 
ifv^O, and D$ = 0, so that D v takes on at most two distinct values and 

ED V = 0. 

Formally, (|2.9() is understood as follows: 

(2.10) Ef{X)I{W £ B} = E(p f {W)I{W £ B} 

for all Borel functions /: R — ► [0, oo) and all Borel sets B C [0, oo), where 

[/(0) ifv = 0. 

That is, (|2.9|l means that 

(2.12) Ef(X)I{W e B} = [ P(W £ dv)Ef(D v )I{v e B}, 

where f and B are as in (|2.10|l . 

This understanding differs somewhat from the way in which the notion 
of the conditional distribution is usually understood. The above meaning is 
more convenient in the applications below, because (|2.11(l can be generalized 
as follows. 

For all Borel functions F: K x E — » [0, oo), 

(2.13) EF(X,W) = I P(W £ dv) EF(D v ,v); 

Jr 

in fact, one can write J^ Q ^ instead of J R in (|2.12|) and (|2.13|) . because 
W ^ a.s. 

The following theorem is quite similar to Theorem 12. II 

Theorem 2.2. (i): There exist an event f2o £ S such that P(ilo) — 1 a> n d 

continuous functions c: Vo — * (— oo,0] and d: Vq — > [0, oo) defined on the 
set Vo := {Y(lo) : u) £ Qq} such that d and (—5) are nondecreasing on Vq, 
and on fig one has 

{X,r{X,U x )} = {c(Y),d(Y)} and — c(Y)d(Y) = Y. 

(ii): the conditional distribution of X given Y coincides with that of Dy •' 

(2.14) C(X\Y) =£(D Y \Y), 
where, for every y £ Vo, D y is a r.v. such that 



Dy = 



d{y) with probability j^yj^-y, 
c(y) with probability j^^j 



if y =/= 0, and D = 0, so that D y takes on at most two distinct values and 



EDy = 0. 
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Formally, (|2.14(l is understood as follows. 
For all Borel functions F: R x R — > [0, oo), 

(2.15) EF(X,Y)= f P(Y e dy) EF(D y ,y); 

in fact, one can write Jj Q > instead of J R in (|2.15() . because Y ^ a.s. 

Remark. It is easily seen from the proof of Theorem l2.2l or. more specifically, from 
the proof of Lemma 1X^1 that Theorem 12 . 21 holds for all r.v.'s Y of the more general 
form VKI-^Ij \ r (X,Ux)\), where tp(u,v) is any expression such that (i) tp(0,0) = 0; 
(ii) tp{u,v) is nondecreasing in u and in v over all nonnegative u and v; and (hi) 
ip(u,v) is strictly increasing in u and in v over all strictly positive u and 

Example 1. Let X have the discrete distribution jq 8-i + So + Si + 82 on 
the finite set { — 1, 0, 1, 2}, where 8 a denotes the (Dirac) probability distribution on 
the singleton set {a}. Then m = and, for x G R, it € (0, 1), and ft, € [0, m], 

G(a;) = & I{x < -1} + ^ I{1 < x < 2} + A I{2 < x}, 

- I{0 < ft < ^} + 2I{^ < ft}, x-(h) = -I{0 < ft}, 

H{-l,u) = ^u, H(0,u) = 0, H(l,u) = ^u, H(2,u) = ^ + ±u, 

r(-l,«)=l{«<|} + 21{«>|}, r(0,u) = 0, r(l,«) = -l, r(2,u) = -l. 

Therefore, the distribution of W is Jq Sa + ^ 82 + S3 and the conditional distribu- 
tions of X given = 0, W = 2, and W — 3 are <5 , 5 <5-i + § Si, and | 5_i + | S 2 , 
respectively. Thus, the zero-mean distribution of X is represented as a mixture of 
(at-most-)two-point zero-mean distributions: 

Equivalently, one can condition here on Y instead of W. The distribution of Y is 
To ^0 + jo Si + 82 and the conditional distributions of X given Y = 0, Y = 1, 
and y = 2 are J , 5 5_i + | and | 5_i + | <5 2 , respectively. 

Remark. A zero-mean distribution can be represented as a mixture of (at-most-) 
two-point zero-mean distributions in a variety of ways. For instance, the symmetric 
distribution jqS-2 + j^S-i + jq-Si + ^j$2 can be represented either as the mixture 
jq{^8_ 2 + |^i) + ijj(§^2 + + 3^(5^-1 l^ 1 ) 01 * w0 as y mme tric and one 

symmetric two-point zero-mean distributions or as the mixture ^(^8-2 + ^82) + 
|(^<5_i + \8i) of two symmetric two-point zero-mean distributions. The latter, 
"more symmetric" representation coincides with the one produced by the method 
of Theorem l2 . II for . equivalently, by that of Theorem l2.2|) . It appears that in general 
this method will produce the mixture representation that is "the most symmetric" 
in an appropriate sense, and hence the best with respect to such applications as 
Corollaries 12 . 41 and 12.61 given below. 

Let us now apply Theorems 12 . II and 12 . 21 to the mentioned asymmetry-corrected 
versions of self-normalized sums. 

Theorem 2.3. Suppose that X\, . . . ,X n are independent zero-mean r.v. 's and 
Ui,...,U n are independent r.v.'s uniformly distributed on [0,1], which are also 
independent of Xi, . . . , X n . For each i = 1, . . . , n, let 
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be a r.v. constructed based on Xi and Ui the way the r.v. W = \X — r(X,Ux)\ 
was constructed in 1)2. 7|) and (|2.8(l based on X and U , where Xi is the reciprocating 
function for (the distribution of) r.v. Xi. Let 

_ X x + ■ ■ ■ + X n 

where the rule jj := is used if the denominator is zero. Then for every nonnegative 
Borel function f on R 

(2.16) Ef(S w ) < max (/(0), sup Ef(Z 1 + ■ ■ ■ + Z n j) , 

where the sup is taken over all n-tuples of independent zero-mean r.v. 's Z%, . . . , Z n 
with the property that each Zi takes on only two values, say Ci and di, such that 

-y/(di - ci) 2 + ■ • • + {d n - c„) 2 = 1. 

For every natural a, let denote the class of all functions / : R — > R such that 
/ has finite derivatives :— /, /W :— f',..., /( Q_1 ) on R, /( a_1 ) is convex on 
R, and /W(-oo+) = for j = 0, 1, . . . , a - 1. 

Corollary 2.4. Under the conditions of Theorem \2.'3\. 

Ef(S w ) < Ef(Z) VfeHl and 

P(S W > x) < c 5 , P(^ >x) Vie G R, 

w/iere c 5i0 = 5!(e/5) 5 = 5.699 .... 

This follows immediately from Theorem 12.31 and results of (Note that every 
function / G Tt 5 + is convex, and so, by Jensen's inequality, /(0) ^ Ef(Z).) 
The following theorem is quite similar to Theorem 12.31 

Theorem 2.5. With the Xi 's and Ui 's as in Theorem \2.'A let for each i = 1, . . . ,n 

Y t := 1X^,(^,(^)^)1, 
where Xi is the reciprocating function for r.v. Xi. For any A > 0, let 

X 1 + ■ ■ ■ + X n 

'-'y.a := - — : m - , 

(F> + ... + yA)w 

where the rule ^ :— is used if the denominator is zero. Then for every nonnegative 
Borel function f on R 

Ef(S Y ,x) < max (/(0), sup Ef(Z 1 + ... + Z n )), 

where the sup is taken over all n-tuples of independent zero-mean r.v. 's Z\, . . . , Z n 
with the property that each Zi takes on only two values, say Ci and di, such that 

|cidi| A + --- + |c„d„| A = l. 

(Note that VaxZi = \cidi\ for all i.) 

Corollary 2.6. Under the conditions of Theorem \2.5V suppose that for some p £ 
(0, 1) and all i G {1, . . . , n} 
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Then for all 



l+p + 2p 2 



if 0<p^i, 
if ±<p<l. 



(2.18) 



1 



one /ias 



where T, 



n 




ing the standardized Bernoulli distribution with parameter p; the function x i— > 
P LC (7ri *5 *s ffte least log-concave majorant of the function x i— > P(T„ a;) on 
03^0 = 2e 3 /9 = 4.4634.... T/ie upper bound C3 v oP LC {T n ^ can &e replaced 
by somewhat better ones, in accordance with |101 Theorem 2.3] or |12l (3.3)]. The 
lower bound \*(p) on A given by Ij2.18|l is the best possible one, for each p. 

Condition l|2.17|l is likely to hold when the Xj's are bounded i.i.d. r.v.'s. For 
instance, (|2.17|) holds with p = | for r.v. X in Example^ 11 place of Xj. 
Corollary 12 . 61 follows immediately from Theorem 12 . 31 and results of |12|. 



We shall precede the proof of the theorems by the statements of a number of 
lemmas (in Subsection 13.1(1 . Next, we shall prove the theorems (in Subsection 13. 2fl . 
Finally, we shall prove the lemmas (in Subsection 13. 3fl . 

3.1. Statements of lemmata. Without loss of generality, one may assume that 
in Theorem O 



To state our lemmas, we need to introduce more notation. Consider the sets 



M+ := {x E (0, oo) : Vy < x P(X E (y, x}) > 0}, 

N + := {x E (0, oo) : P(X = x) = 0}, 

L+ := {x e (0, oo) :3y<x P(X e (y, x)) = 0}, 

= {x E (0, oo) : 3y E [0, x) P(X e (y, x)) = 0}, 
M_ := {x e (-oo, 0) : Vy > x P(X E [x, y)) > 0}, 
N- := {x E (-oo, 0) : P(X = x) = 0}, 
L- := {x e (-oo, 0) : 3y > x P(X E (x, y)) = 0} 

= {xE (-oo,0): 3y E (a, 0] P(X E (x,y)) = 0}, 
M:=M+UM_, 
N := N + UN_, 
L := L+ U L_. 



3. Proofs 



P(X = 0)^1. 



Hence, 



m € (0, oo). 
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Note that 

(3.1.1) N+HL+ = (0,oo)\M+, iV_ nl_ = (-oo,0)\ M_. 

Now we can introduce the sets 
£+ := 

(3.1.2a) x G M+, < it < 1, 

(3.1.2b) i£Af + u = 1, 

(3.1.2c) ieL + =^«>0, 

(3.1. 2d) Ppf > x) = (as i N+ & it < 1) j, 

(3.1.3a) x G M_, < u < 1, 

(3.1.3b) x G JV_ => u = 1, 

(3.1.3c) i£L u > 0, 

(3.1.3d) P(X < a;) = =>• (x £ iV_ & u < 1) j, 

(3.1.4) e:=e+U£_. 
Note that 

(3.1.5) e+ng_=0, 

because Af+ n Af_ C (0, oo) n (-oo, 0) = and in view of l|3.1.2a() and l|3.1.3a|) . 
Lemma 3.1. 

P(X i M U {0}) = 0. 
Lemma 3.2. (Recall definitions i|2.'2|) . 1)2. 3[l . and 1)2.4)1 . _) For ft G (0, m] 

(3.1.6) x+(h) = mm{x G (0, oo] : G(x) ^ ft}; 

(3.1.7) x_ (ft) = max{x G [-oo, 0) : G(x) ^ ft}; 

(3.1.8) G(y)<hVye [0,x+(h)), G(x+{h)) > h > G(x+{h)-); 

(3.1.9) G(y) < ft Vy G (x_(ft),0], G(x-(h)) > ft > G(x_(ft)+). 
//, moreover, ft G (0, m) iften 

x+(ft) G (0, oo) and X-(h) G (— oo, 0). 

For 

ft G (0, m], 

let 

1 otherwise, 
I 1 otherwise. 
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H{x, u) 



Lemma 3.3. The formula 

(3.1.11) (0,m) — > (x + (h),u+(h)) G 5+ 

defines a one-to-one map of the interval (0,m) onto G+, anrf //ie inverse map is 
given by the formula 

(3.1.12) 9 (x, u) i — > /i+(x, it) := G(x-) + u ■ (G{x) - G{x-)) G (0, m). 
Similarly, the formula 

(3.1.13) (0,m) 9/ii — ► (x_(/i),u_(/i)) e5- 

defines a one-to-one map of the interval (0,m) onto G-, and the inverse map is 
given by the formula 

(3.1.14) G- 9 (at,«) ' — > h^{x,u) := G(x+) + u ■ (G{x) - G(x+)) G (0,m). 
Note that 

!h + {x,u) for (x,u) £ 
h-(x,u) for (x, u) G 

where H(x,u) is given by ((2.611 . 

Now, using maps 1(3. 1.11(1 and (|3.1.13|l and their inverses (|3. 1.12(1 and 1(3.1.14(1 . 

one can define a one-to-one map of Q onto Q 

(3.1.15) GB(x,u)< — >{x,u)eG 
by formulas 

{x-{h+(x,v)),u-{h+{x,u))) if (x, u) G G+, 

(x + (h-(x,u)),u + (h-(x,u))) if (x,w) G G-- 

Thus, the one-to-one map ((3.1.15(1 is inverse to itself. It maps G+ onto G- and G- 
onto G+, and the latter two correpondences can be presented as follows: 

G+ 9 {x, u) < — ► h = h + (x. u) = h-(x, u) < — > {x,u) 9 G- , 
G- 9 (x, u) < — > h = h-(x,u) = h + (x,u) < — ► (x, u) 9 G+- 
Remark 3.4. For x defined by ((3.1.16|) and r defined by 1(2. 5|) . one has 

r(x, u) = x 

for all (x, u) G G- 

Let us now introduce the map 

(3.1.17) [0,m] 9 h i — ► w(h) := x + (h) - x-{h). 
Introduce also the set 

(3.1.18) V :={w(h): he(0,m]}. 

Lemma 3.5. The functions X+, (—£_), and it; are nonnegative and nondecreasing 
on [0,m], and positive and left- continuous on (0,m]. 

Lemma 3.6. Assume that w{h,2) = w(h\) + e for some e G [0, 00) and some hi 
and hi in [0,m]. Then 

< x + (h 2 ) — x + (hi) < e, ^ X-(hi) — x~(h 2 ) < £. 

As an immediate corollary to Lemma 13.61 one obtains the following. 



(3.1.16) (x,u) 
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Lemma 3.7. If w{h,2) = w(h\) for some hi, /12 in [0, m], then X+Q12) = x+{hi) 
and X-{h2) = X-(hi). Thus, for h G [0, to], the values of x+(h) and x-{h) are 
uniquely determined by the value of w(h). Moreover, there are nonnegative nonde- 
creasing continuous real functions, say —c and d, defined on VUjO} (see (|3. 1.18(1 ) 
such that for all h G [0, m] 

(3.1.19) x + (h) = d(w(h)) x-{h) = c{w{h)), and d(w(h)) - c(w(h)) = w(h). 

Furthermore, by Lemma lH. 5\ the functions c and d vanish only at and are Lipschitz 
with Lipschitz constants ^ 1. 

Remark 3.8. Take any pair (x,u) G Q. It follows from Lemma 13.31 Lemma 13.71 
Remark E3I IpHZll , and 1(3.1.18(1 that v := \x - r(x,u)\ G V. Moreover, v = 
d(v) — c(v) and 

• if x > 0, then x = d(v) and r(x, u) — c(v); 

• if x < 0, then x = c(v) and r(x,u) = d(v). 

Lemma 3.9. There is a strictly increasing function t: V U {0} — » K such that 

(3.1.20) \x\ \r(x, u)\ — t(|x — r(x, u)|) for all (x, u) G Q , and r(0) = 0. 
For v eV, let 

h v :~ sup{/i G (0, to] : w(h) ^ v}. 
By the definition l(3.1.18J) of V, the set {h G (0, to] : w(h) ^ v} is non-empty. 
Moreover, by Lemma [3.51 the function w is left-continuous and nondecreasing on 
(0, m]. Therefore 

(3.1.21) h v = max{/i € (0, to] : w(h) < v} 
and 

(3.1.22) w(h v ) = v. 

Lemma 3.10. For any v G V, 

(i) : if (x,u) G G+, then 

\x — r(x,u)\ ^ v (x < d(v) or (x = d(v) & h + (x,u) ^ h v ^; 

(ii) : if (x,u) G Q~, then 

\x — r{x, u)\ ^ v <^=> (x > c(v) or (x = c(v) & h_(x,u) ^ ft-u)^; 

Remark. It can be seen from the proof of Lemma 13.101 (or otherwise) that the 

condition (x < d(v) or (x = d(v) & h + {x,u) ^ /i u )^ can be replaced by the 

seemingly simpler one: (x ^ d(v) & h + (x, u) ^ /i^). However, the form used in the 
formulation of Lemma 13.101 will be more convenient when Lemma |3. 101 is applied. 
A similar comment can be made concerning the corresponding condition in part 
(ii) of Lemma T3. 101 

Lemma 3.11. Let X and Ux be as in Theorem \2.1\ Then 

P(X ^Q,{X,U x )tg) = Q. 
Lemma 3.12. Let X and Ux be as in Theorem \2.1\ Then for all v G [0, 00) 

EXI{W ^ v} = 0; 

recall the definition 1(2. 8|l of W . 
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Lemma 3.13. Let X and Ux be as in Theorem \2.1\ Then Lemma \S.lS\ can be 

generalized as follows: for any Borel set B C [0, oo), 

£X1{W eB} = 0. 

Let us say that a Borel set C C (0, oo) is null if P(W € C) = 0. Note that, if B 
is a null set, then identity (|2.1U|) holds, because both sides of it are zero. 

In the case when a Borel set C C (0, oo) is not null, it must contain a point 
v £ V. (indeed, by Remark [3.81 the range of W on the event {(X,Ux) G Q} is 
contained in V. Also, by Lemma fH. Ill the event {X ^ 0, (X, Ux) $ G} is of zero 
probability. Finally, W G C C (0, oo) implies W ^ and hence X ^ 0.) 

In the case when a bounded Borel set C C (0, oo) is not null, let 

(C) := sup{rf(w): veVDC}, 
dmin(C*) := inf{d(«) : v G V n C}, 

L max 

(C) := sup{c(w): C}, 
(C) := inf{c(u): u^flC}; 

note that, by Lemma 13.71 the first two of these four numbers are in [0,oo), while 
the last two of them are in (— oo, 0]. 

In addition, for any Borel function / : R — > [0, oo), let 

/r,max(C) := sup{/(x): x G [d m in(C), d max (C)]}, 
/r,min(C) := inf {f(x) : x G [d min (C) , d max (C)] } , 
j£,max(C) := sup{/(x): X G [c m i n (C),c max (C)]}, 
h,min(C) := inf{/(.T): x G [c min (C), c max (C)]}. 

Here, r and £ stand for "right" and "left" , respectively. 

For any e > 0, let us say that a bounded Borel set C C (0, oo) is (d, e)-good if it 
is not null and is such that 

< 

"max 

Similarly, let us say that a bounded Borel set C is (c, e)-good if it is not null and is 
such that 

< -c min (C) < e £ (-c max (C)); 

recall that c m i n (C) ^ c max (C) < 0, for any C G (0, oo). 

Let us say that a bounded Borel set C c (0, oo) is (/, e)-good if it is not null and 
is such that 

< /, %max (C) < e e / r , roin (C) and < ft, max (C) < e e /^ mi n(C). 

Let us say that C is e-good if it is (d, e)-good, (c, e)-good, and (/, e)-good. 

Let us say that a partition of a bounded Borel set B is Borel if every member 
of the partition is a Borel set. Let us say that such a partition is {d,e)-good if 
every member set of the partition is cither null or (d, e)-good. Similarly defined are 
(c, £)-good, (/, e)-good, and e-good partitions. 

Lemma 3.14. For any bounded Borel set B G (0,oo), any e G (0, oo), and any 
everywhere strictly positive and continuous function f , there always exists an e-good 
partition of B. 
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Lemma 3.15. For any Borel function f: R — ► [0, oo), any bounded Borel set C C 
(0,oo), and any e £ (0, oo), if C is null or e- good, then (recall H2.11J) ) 

i 2 e~ 4e &pj(W) 1{W £ C}< E/(X) I{W e C} 

^e iE Etp f (W)I{W eC}. 

Let 

£>(1) £>(«) 

be independent r.v.'s such that, for each j 6 {1, . . . , n}, the r.v. D$ is constructed 
based on the distribution of Xj the way the r.v. D v was constructed in Theorem 
12. II based on the distribution of X. 

Lemma 3.16. Let F(xi,v\, . . . ,x n ,v n ) be a nonnegative Borel function of its 2n 
real arguments. Let X\, . . . , X n , Wi, . . . , W n be as in Theorem \2.tft Then identity 
(I2.13[l can be generalized as follows: 

EF{X l ,W u ...,X n ,W n ) 

(3.1.24) 



3.2. Proofs of the theorems. 

Proof of TheoremVn\ (i) Let fi := {X = 0} U {{X, U x ) £ Q}- Then, by Lemma 
EHT1 one has P(ft ) = 1 and, by Remark V C V U {0}. The rest of part (i) of 
Theorem 12 .11 now follows by Remark 13.81 and Lemma l3~7l 

(ii) Here we need to prove identities (|2.10|l and l|2.13|l . We shall do this in a few 
steps. 

Step 1. Here we shall prove (|2.1()(l assuming that (a) the function / is continuous 
and strictly positive everywhere on K and (b) the Borel set B is a bounded subset 
of(0,oo). 

By Lemma 13.141 for any e 6 (0,oo), there exists an £-good partition of B. 
Applying Lemma 13.151 to every member set of such a partition and then summing 
over all the member sets, one sees that inequalities (13.1. 23|) hold for the entire set 
B, in place of C. 

Since e > was chosen arbitrarily, this implies that l|2.10|l holds whenever the 
function / is continuous and strictly positive everywhere on R and B is a bounded 
Borel subset of (0, oo). Thus, Step 1 of the proof of H2.10(l is now complete. 

Step 2. If B is any Borel subset of (0, oo), then the sets B n ;= B fl (0,n] are 
bounded for all n £ (0, oo), so that, according to Step 1, (|2.10(l holds with B n in 
place of B. It remains to let n — * oo to see that (I2.10H holds whenever the function 
/ is continuous and strictly positive everywhere on R and the set B is any Borel 
subset of (0, oo). 

Step 3. By Q2.5p . if x ^ 0, then — r(x,u) is either or of the same sign as x. 
Hence, one always has \W\ = \X — r(X, Ux)\ ^ \X\, so that W = always implies 
X = 0. Therefore and in view of (|2.11|) . identity l|2.10|l holds for any function / 
provided that B = {0}. Thus (cf. Step 2), (|2.1U|) holds whenever the function / is 
continuous and strictly positive everywhere on R and the set B is any Borel subset 
of [0,oo). 

Step 4. Since the er-algebra generated by the set of all bounded continuous 
strictly positive on R functions is the entire Borel cr-algebra, we conclude by a 
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functional form of a monotone class argument that p.lOjl holds whenever / is a 
nonnegative Borel function on K (and the set B is any Borel subset of [0, oo).) 

Step 5. Identity l|2.1L)|) (or its equivalent (|2.12[l ) implies that (|2.13|) holds for all 
Borel functions F of the form F(x, v) = I{x £4,d€ B}. Then, again by a mono- 
tone class argument, (|2.13|l continues to hold for all nonnegative Borel functions 
F. 

The proof of Theorem 12. II is now complete. □ 

Proof of Theorem \2.2\ Take here the same fjn as in the proof of Theorem l2~Tl Then, 
by Lemma 13.91 on Qq the r.v. Y is a strictly increasing (and hence one-to-one) 
transformation r of r.v. W. Now Theorem 12.21 follows, with c := c o t _1 and 
d:=dor -1 . □ 



Proof of Theorem \2.3l The idea of the proof is simple. Since X\, . . . , X n , 
Ui, . . . ,U n are all independent and, for each i, the r.v. Wi is a function of Xi and 
Ui, it follows that the pairs (Xi, Wi), ■ ■ ■ , (X n , W n ) are independent. Therefore, for 
each i, the conditional distribution of Xi given W\, . . . , W n is the same as that of 
Xi given Wi. By Theorem l2.il the latter conditional distribution coincides a.s. with 
the unique zero-mean distribution on the set {ci(Wj), dj(Wi)}, where the functions 
Ci and di are constructed based on the (original, unconditional) distribution of Xi 
the way the functions c and d were constructed in the proof of part (i) of Theorem 
12.11 based on the distribution of X; at that, di{W%) — Cj(Wj) = Wi a.s. Hence, 
conditionally on Wt, ■ ■ ■ , W n , the r.v.'s 

y ._ Xt ■ _ , 

Zj j . — "~ ~ , 2 — 1 ..... 72 , 

are independent and each Zi is zero-mean and takes on (at most) two values, 

* - «w and z ._ 



so that — c,- = W,/(|yWf + ■ ■ • + W^) a.s., whence a.s. 



^-Ci) 2 = l. 

\ i=i 



This implies that, for all nonnegative Borel functions / 

E(f(S w )\W u ...,W n )^ max (/(0), sup E/(Yi + • • • + Y n )) 

a.s., where the sup is described in the statement of Theorem 12.31 Now inequality 
(|2~Td|) follows. 

Let us now give a formal proof of this inequality; it is based on Lemma 13.161 
Since Wi ^ a.s. for all i = 1, . . . , n, integral J R „ in (|3. 1.241) can be replaced by 
I[o oo)"' Therefore, under the conditions of Lemma l3.16l one has the inequality 



EF(Xx,Wi,...,X n ,W n 
</! ' 2 '" sSsup{EF(D« D$,v n ): { Vl , ...,v n ) e [0, oo)"}. 
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Now, for any nonnegative Borel function / on K., let 

if «? + ••• + vl ^ 0, 




F f (x 1 ,v 1 ,...,x n ,v n ) := ^ \5V' y i + ^ w n/ 

/(0) otherwise 

Note that, for i = 1, . . . , n, the r.v.'s 




V u i + •■■ + «« 



if + . . . + u 2 ^ Q 5 

otherwise 



are independent, and each Zi is zero- mean and - provided that v\ + ■ ■ ■ + v 2 n ^ 
takes on (at most) two values, 

Ci(Vi) 7 di(Vi) 

and dj := 



\y/v\ + --- + vi ^ Iv^i + ■■• + «« 



so that di — di = Vi/(h y/vf + ■ ■ ■ + v%) and 



\ i=i 



This and inequality l|3.2.1|) imply inequality (|2.16|) for all nonnegative Borel func- 
tions /. □ 

Proof of Theorem \2.5\ This proof is quite similar to that of Theorem 12.31 using 
Theorem in place of Theorem O □ 

3.3. Proofs of the lemmata. 

Proof of Lemma ^H For every x £ R \ (M U {0}), let A x denote the union of the 
set, say J x , of all (closed, open, or semi-open) intervals 5 such that 5 3 x and 
P(X £ 8) = 0. Then A x is an interval. (Indeed, if x\ and xi are in A^,, then 
%i £ #i C Aj, and £2 £ (52 C A^ for some intervals <5i £ JT^ and 5i £ 3 X \ it follows 
that the union <5i U 5% is an interval which is an element of the set J x , and also 
Si U 8% 3 {xi,X2}. Thus, for every two points x\ and X2 which are in A^, all the 
points between x\ and X2 are also in A^, so that A^ is an interval.) Moreover, the 
interval A x is non-empty and, furthermore, it is of nonzero length, because, by the 
definition of M, for every x € K \ (M U {0}), the interval A^ contains an interval 
of the form (y, x] for some y < x or of the form [x, y) for some y > x. 

Observe next that, for every x £ K \ (M U {0}), one has P(X £ A x ) = 0. 
Indeed, assuming that (M U {0}), let [a, b) be any closed subinterval of A^. 

Then there exist intervals 5 a and 5b in J x such that a £ 5 a and b £ 5b- Hence, 
x £ 5 a r\5b, P(X £ <5 a ) = 0, and P(X £ 5b) = 0, so that [a, 6] C <5 a U<Sfc, which implies 
P(X G [a,b]) ^ P(X £ 5 a ) + P(X £ 5 b ) = 0. Thus, P{X £ [a,b]) = for every 
closed subinterval [a, b] of A^,. If the interval A^ is itself closed, this implies that 
P(X £ A x ) — 0. If, for instance, A^ is a (necessarily non-empty) interval [c, d), 
semi-open on the right, and d n | d, then P(X £ A x ) = lim„ P(X £ [c, d n ]) = 0. 
The cases when the interval A x is open or semi-open on the left are considered 
similarly. This proves the observation. 
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Observe further that, for any two points x and y in R \ (M U {0}), the intervals 
A x and A y are either disjoint or the same. Indeed, suppose that (i) A x and A y are 
not disjoint and (ii) A y \ A x ^ (for instance). Then A := A x U A y £ J x , while 
A <2 A x ; this contradicts the definition of A x . 

Therefore, the set {A^: x £ R \ (M U {0})} coincides (for some index set I) 
with a set {5; : i £ /} of intervals of nonzero length such that £j n Sj = for 
any two different indices i and j in 7. For every i £ J, one can choose a rational 
point r"i £ Si, and these points will necessarily be distinct, since the intervals Si 
are disjoint. Therefore, the index set I must be countable. Since x £ A x for every 
x £ R \ (M U {0}), one concludes that 



Proof of Lemma \S. l A Let /i £ (0, m]. Since m = G(oo) = lim^oo G(x), there exists 
some x £ (0, oo] such that G(x) ^ h. For any such X, ()2.3)) implies a;+(/i) ^ x. 
Moreover, the right-continuity of G on [0, oo) implies G(x+(h)) ^ h (the latter 
inequality is trivial if x+(h) — oo). The inequality G(x+(h)) ^ /i, together with 
h > and G(0) = 0, yields x + (h) ^ 0. Thus, one has 13.1.61) . which, in turn, 
implies IjH.l.SJ) ■ Relations 1)3.1.7(1 and l(3.1.9|) are verified similarly. The last sentence 
in Lemma 13.21 is now obvious. □ 

Proof of Lemma \8.!A (I) Take any h £ (0, m). At this point, let us check that 
(x + (h),u + (h)) £ Q + . In other words, let us check that requirements l|3.1.2l) are 
satisfied if x and u are replaced there by x+(h) and u+(h), respectively. 

(I)(i) Here we shall check that requirement l|3.1.2al) is satisfied if x and u are 
replaced there by x + (h) and u + (h), respectively. That ^ u + (h) ^ 1 follows 
immediately from l(3.1.1Q|l and the second part of H3.1.8J) . 

It remains at this point to check that x+(h) £ M + . By Lemma [3.21 x+(h) £ 
(0, oo). Assuming now that x + (h) £" M + , one has P(X £ (y, x + (h)]) — for some 
y £ [0,x+(h)), so that G{y) = G(x + (h))- EX \{y < X ^ x+{ h)} = G {x+{h)) > h, 
which contradicts the first part of (|3.1.8|l . Thus, requirement 1)3.1. 2a|l is checked. 

(I) (ii) It follows immediately from 1)3.1.10(1 that requirement 1)3.1. 2b)l is satisfied 
if x and u are replaced there by x + (h) and u+(h) respectively. 

(I)(iii) Here we shall check condition ()3.1.2c)l for x + (h) and u+(h) in place of 
x and u. In view of point (I)(ii) above, one may assume that x + {h) £ L + \ N + 
but u + (h) = 0. Then By £ [0,x + (h)) P{X £ {y,x+{h))) = 0, and (|3.1.10|) implies 
that G(x+(h)-) = h. Hence, G(y) = G(x+{h)- ) - EX I{X £ (y,x + (h))} = 
G(x+(h) — ) = h, which contradicts the first part of 1)3.1.8)1 . 

(I)(iv) Let us now check condition (|3.1.2dfl for x + (h) and u+(h) in place of x 
and u. Assume that P(X > x + (h)) = 0. Then G(x + (h)) = m. If x + (h) £ N + , then 
G(x + (h)— ) = G(x+(h)) = m > h, which contradicts the second part of ()3. 1.8)1 . 
Hence, x+(h) ^ N + . If now u + (h) — 1, then 1)3.1.10)1 implies G(x + (h)) — h, which 
is in a contradiction with G(x+(h)) — m > h. 

The verification of point (I) is now complete. 




because each Si coincides with some of the A x 's. Now Lemma ,11 follows. 



□ 



t-TEST WITHOUT SYMMETRY 



17 



(II) Let us check next that map ((3.1.11(1 is onto Q + . Take any (x,it) £ Q + and 

let 

(3.3.1) h:=G(x-)+u-(G(x)-G(x-)). 

We need to check that (i) ft £ (0, m), (ii) x+(ft) — x, and (iii) w+(ft) = u. 

(II) (i) Here we shall check that ft G (0,m). Indeed, the condition (x,u) G G+ 
implies x G M + , so that P(X G (0, a;]) > and hence G(x) > 0. If G(x— ) > 0, 
then 1(3.3.1(1 implies ft > 0. 

Consider now the case G(x— ) = 0. Then x ^ iV+, because G(x) > 0. Also, 
here x G L + , because the equalities G(x— ) = = G(0) imply P(X G (0,x)) = 0. 
Therefore, conditions (x,u) G Q+ and l|3.1.2c|l imply that u > 0, so that 1(3. 3.1(1 
yields ft. = uG(x) > 0. Thus, ft > in all cases. 

It remains at this point to check that ft < m. This follows from 1(3.3.1(1 in the 
case G(x) < m, because G(x— ) < G(x) and < u ^ 1. Since G(x) < G(oo) = m, 
it remains here to consider the case G{x) — m. Then one has P(X > x) = 0, so 
that, by l(3.1.2d|) . x £ N + and u < 1. Now ((3.3.111 implies ft < G(x) = m. Thus, 
ft < m in all cases. 

(II) (ii) Here we shall check that x+(ft) — x. Take any y G [0, a;). (Such a y 
exists since x G M + G (0,oo).) To obtain a contradiction, suppose that ft ^ G(y). 
Then ft ^ G(x— ). On the other hand, conditions 1(3. 3. 1|) and ^ u ^ 1 imply 
ft ^ G(x— ). Hence, ft = G(x— ), and then ((3.3.1(1 implies it • (G(x) — G(x— )) = 0, 
which in turn implies that either x G -ZV + or x ^ i + (indeed, if x ^ -/V + , then 
w • (G(x) — G(x— )) = implies u = 0, so that, by l(3.1.2c(l . one has x ^ £+)• Taking 
now ((3.1.1(1 into account, it follows now that x G M+ D (N + U L c + ) = L c + , where we 
let L c + := (0, oo) \ L + , for brevity. Hence, for all y G [0, x) such that ft ^ G(y) one 
has P(X G (y, x)) > 0, so that ft = G(x— ) > G(y), a contradiction. Thus, G(y) < ft 
for all y G [0,x). On the other hand, 1(3.3.1(1 and ^ u ^ 1 imply ft ^ G(x). Now 
(13.1.6(1 yields x + (ft) = x. 

(II) (iii) Here we shall check that u + (h) = u. This follows from 1(3.1.10(1 . 1(3.3.1(1 . 
and (II) (ii) in the case x ^ N + . If x G N+, then, by l(3.1.2b(l . u = 1, so that 
n + (fe) = u bv i3.1.l0ll . 

The verification of point (II) is now complete. 

(III) Let us check next that map 1(3.1.11(1 is one-to-one and its inverse is given 
by ((3.3.1(1 . Indeed, it follows by the first line of 1(3.1.10(1 in the case x N~ + and by 
the second part of ((3.1.8(1 in the case x G N + that, if x+(ft) — x and u + (h) = u, 
then the value of ft is given by 1(3.3.1(1 . and is thus uniquely determined by x and u. 

Thus, the first half of Lemma 13. 31 is proved. The proof of its second half is quite 
similar. □ 

Proof of Lemma \3.5l That x+, — x_, and w are nonnegative and nondecreasing on 
[0,m] and positive on (0, m] follows immediately from 1(2.3(1 . 1(2.4(1 . Lemma l3~2l and 

Let now ft G (0, m], h n f ft, x n := x + (ft„), and x := x + (ft). Then, because x+ is 
nondecreasing, one has x n S y for some y G (0,x]. 

To obtain a contradiction, assume that y < x. Let z G (y, x). Then, by the 
first part of 1(3.1.8(1 . G(z) < ft. On the other hand, y ^ x„ for all n. Hence, 
ft > G(z) ^ G(y) ^ G(x„) ^ ft„, by the second part of 1(3.1.8(1 . This implies 
ft > G{z) ^ ft, which is a contradiction. 
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It follows that x+ is left-continuous on (0,to]; similarly, for x~ and, in view of 

crm . for w. □ 

Proof of Lemma \S.f>\ To obtain a contradiction, assume that x+(h 2 ) — x+(hi) 

< 0. Then h 2 < hi, since x+ is nondecreasing (by Lemma |3.5|) . Hence, again by 

Lemma 13.51 X—(h\) — X-Qi^) ^ 0. By re-grouping terms, it follows that 

(3.3.2) < e = w(h 2 ) - w{hi) = (x+(h 2 ) - x+(hi)) + (z-(fci) - MM) 

<0, 

a contradiction. Therefore, x+(/i2) — x+(h±) 0. Similarly is shown that X—(hi) — 
X—ihz) 0. Now Lemma f3 . 61 follows from ((3.3.2(1 . □ 

Proof of Lemma POl In view of Remark l3.8l the function r :— \c\d satisfies ((3.1.20(1 
(in fact, this is the only such function). By Lemma 13.71 functions |c and d are 
nondecreasing and vanish only at 0, and also (in view of 13.1.1811 ) \c\(v) +d(v) = v 
for all v 6 V U {0} — > R. It remains to show that r is strictly increasing. Take any 
Vi and v 2 in V U {0} -> M such that < «i < v 2 . Then r(« 2 ) = \c\(v 2 )d(v 2 ) > 0, 
< |c|(«i) < |c|(« 2 ), and < d(v x ) < d(v 2 ). So, if \c\(vi) = or d(v x ) = 0, then 
r(wi) = < t(v 2 ). Also, the identity \c\(v) + d(v) = v implies that at least one of 
the inequalities |c|(i>i) ^ c| (^2) and d(v\) ^ d(v 2 ) must be strict. Therefore, in all 
cases t(vi) = \c\(vi)d(vi) < |c| (^2)^(^2) = t(v 2 ). □ 

Proof of Lemma \3.1(A Let » £ 7. Let us prove part (i) of Lemma [3.101 Accord- 
ingly, assume that (x,u) G G+- In view of (|3. 1.22(1 . 1(3.1.19(1 . and 1(3.1.17(1 . one has 

^ d(v) = d(w(h v )) — x + (h v ), c(v) — c(w(h v )) = x-(h v ), 

v = w(h v ) = x + (h v ) — X-(h v ). 

Let now (recall ((3.1.1210 

(3.3.4) h:=h + (x,u), 

so that, by Lemma f3. 31 and definitions 1(2.5(1 and 1(3.1.17(1 . 

h G (0,m), x = x+(h) > 0, r(x,u) — X-(h) < 0, 
^ ^ \x — r(x,u)\ = x — r(x,u) = w(h). 

Now let us prove the "=>" implication of part (i) of Lemma 13.101 Assume that 
\x — r(x,u)\ ^ v, which can be rewritten, in view of the last equality in 1(3.3.5(1 . as 
w(h) < v. Now it follows from 1(3.1.21(1 that 

(3.3.6) h^h v . 

Moreover, ((3.3.5(1 and ((3.3.3(1 together with Lemma imply that x ^ d(v). Thus, 
in view of 1(3.3.4(1 and 13.3.6(1 . the implication is checked. 

Next, let us prove the a <=" implication of part (i) of Lemma 13.101 Indeed, 
consider first the case x < d(v), which can be rewritten, again in view of 1(3.3.5(1 
and 1(3.3.3(1 . as x + (h) < x+(h v ); then, by the "nondecreasing" part of Lemma 13.51 
and ((3.1.22(1 . one has h < h v and hence \x — r(x, u)\ = w(h) sC w(h v ) — v. Consider 
the remaining case when x = d(v) & h ^ h v . Then, applying 1(3.3.5(1 . Lemma 
13.51 and ((3.1.22(1 . one obtains \x — r(x,u)\ — w(h) ^ w(h v ) — v. Thus, the "<^=" 
implication is also checked. 

Thereby, part (i) of Lemma 13.101 is proved. Part (ii) of the lemma is proved 
similarly. □ 
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Proof of Lemma Vm\. Recalling the definitions of Q, Q+, and G- ( ifTPjl . (|3~T"2l) . 

(|3.1.3jl ) and the relations M+ C (0, oo) and Af- C (— oo,0), one has 
(3.3.7) 

p(x ± o, (x, u x ) £G) = p(x > o, (x, u x ) i g+) + p(x < o, {x, u x ) i G-). 



Next, 
(3.3.8) 
where 



Q^P{X>Q,{X,U X )£G+) 
^P(X >0,X £ M+) + P(U = 0) + P(X G K+) + P(U = 1), 

K+ := {x G (0,oo): P(X >x)=0,xe N+} 
= {xe (0,oo): P(X ^ x) = 0}. 

The four sommands in l|3.3.8(l correspond to the restrictions on {x, u) in the defini- 
tion of G+ . Namely, the first two summands correspond to restrictions (|3.1.2a(l and 
(|3.1.2cfl . respectively, while the last two summands correspond to i|3.1.2d|) . Note 
that restriction l|3.1.2b[) is already taken care of by definition i|2.7|l of U x . 

The second and the fourth summands in i|3.3.8|) are zero, because r.v. U is 
uniformly distributed between and 1. The first summand is zero by Lemma 13. II 
If K + = 0, then the third summand is zero as well. 

Assume now that K + ^ 0. Observe that, if x G K + and y G (ie, oo), then 
< P(X ^ y) < P(X ^ x) = 0, whence y G K+. This implies that K + is an 
interval, either of the form (a, oo) for some a G [0, oo) or of the form [a, oo) for 
some a G (0, oo). 

Therefore, if a G K + , then K+ = [a, oo), and so, P(X G K+) = P(X > a) = 0. 
In the other case, when a £ K+, one has K + = (a, oo), and so, P(X G K + ) = 
P(X > a) — limn^oo P(X ^ a + — ) = 0. Thus, in all cases the third summand in 
(I3.3.8|l is zero. 

Hence, P(JT > 0,(X,U x ) j G+) = 0. Similarly, P(X < 0,(X,U x ) £ G-) = 0. 
Now Lemma l3~TT1 follows by (j3"X?|) . □ 

Proof of Lemma VS.VA Take any i? G [0, oo). In view of Lemma |3. Ill and formulas 
(|3~Q|l and (|3~T3|l . 

EX I{|X-r(X,C/ x )| ^v} 
(3.3.9) = EX I{(X, Ux) SQ,\X- r(X, U x )\ s$ v} 

= EXI{(X, C/ x ) G G+, \X - r(X, U X )\ < «} 
( '' } +EXI{(X,C/ x )Ga-,|X-r(X ) C/ x )K4 

From this point on, the proof proceeds differently depending on properties of 
the value of v. We consider separately the following cases: (I) V n (0, v] — 0; (II) 
v G V; (III) V is any upper bound of V; and (IV) v G W2) for some and v 2 in 
V. These cases are clearly exhaustive. However, in general, not all of these cases 
are mutually exclusive. 

(I) Consider first the case V C\ (0, v] = 0. By Lemma lO and l|3.1.18|l . (x, u) G G 
implies that \x — r(x,u)\ G V. Therefore, the expression in (|3.3.9[1 is zero. Thus, 
Lemma 13.121 is proved in the case V n (0, v] = 0. 

(II) Next, consider the case v G V. 
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In this case, by Lemma 13 .101 and also again Lemma 13.111 
EXI{(X,U x )eg + ,\X-r{X,U x )\^v} 

= EX1{(X,U X ) £ G+, {X < d(v) or (X = d{v) & h+(X,U x ) < K))} 
= EXI{0 < X < d{v) or {X = d{v) & h+(d(v),U d{v) ) ^ h v j)} 

(3.3.11) = G(d(v)-) + d(v)P(X = d(v))P(h + (d(v), U) < h v ); 

the last equality is obvious if d(v) G N + , and it follows from the definition (|2.7() 
and the independence of X and U if d(v) ^ N + . 
Note that 

d(«)P(A" = d(v)) = G(d(v)) - G(d(«)-). 
Recall that, in view of (|3.1.22|l and (|3.1.19|) . 

(3.3.12) d(t>) = d(w(h v )) = x+(h v ). 

If h v = m then, by Lemma and (|3.1.22|) . tt?(/i) ^ w(h v ) — v for all h G [0, m]; 
that is, u is an upper bound of the set V, so that one has Case (III), to be considered 
next. 

It remains here to consider the case h v < m. 
Consider the two possible subcases. 

Subcase 1: d(v) £ N + . In view of l|3.3.12|l and l|3.1.12|) . for any u e [0, 1], the 
expression in l|3.3.11f) equals 

G(d(v)-) = G(d(v)-)+u-(G(d(v))-G(d(v)-)) = h+(d(v),u) = h+{x+(h v ),u). 

Now, substituting here u+(h v ) for u, one has by Lemma 13.31 that . in Subcase 1, the 
expression in l|3.3.11|l equals h v . 

Subcase 2: d{v) £ N + . Here, in view of (|3.3.12|l . (|3. 1.12(1 . and l|3.1.10|l . one has 

P(h+(d(v),U) < K) = P{h+{x+(h v ),U) ^ hv) 

= P(G(x+(h v )-) + U ■ {G(x + (h v )) - G(x + (h v )-)) < h v ) 

= P(U ^u+{h v )) = u+{h v ). 
Hence, in Subcase 2, the expression in 1(3.3.11(1 equals 

G(d(v)-) + u+(h v ) ■ (G(d(v)) - G(d(v)-)) = h+{d{v),u+{h v )) 

= h + (x + (h v ),u + (h v )) = h v , 

by ((3.1.12(1 . ((3.3.12(1 . and Lemma IO 

Thus, in both Subcase 1 and Subcase 2, the expression in 1(3.3.11(1 equals h v . 
That is, the first summand in 1(3.3.10(1 equals h v . Similarly, the second summand 
in ((3.3.10(1 equals — h v . Now Lemma f3 . 1 21 follows - for all v E V. 

(III) Next, if v is any upper bound of V then, by 1(3.1.18(1 and Lemma 13.31 
{x,u) G G+ implies \x — r(x,u)\ ^ v, so that, in view of Lemma 13.111 the first 
summand in 1(3.3.10(1 equals EX 1{X > 0} = to; similarly, the second summand in 
((3.3.10(1 equals —to. Thus, Lemma 13.121 is proved in the case when v is any upper 
bound of V. 

(IV) It remains to consider the case when v G («i, ^2) for some v\ and v-i in V, 
so that Vi — w{hi) for some hi G (0, to], where i = 1, 2. Let 

V* := sup(VD (0,v}). 

Then G (0, v] (because Ui G V n (0, v] and hence V l~l (0, v] ^0). 
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Moreover, e V, so that 

(3.3.13) :=max(^n (0,v\). 

Indeed, otherwise there is a strictly increasing sequence (v n ) in V PI (0, v] which 
converges to u*. Then, by l|H.1.18|l . there exists a sequence (/i*) in (0, m] such that 
u„ = w(h* n ) for all n. By Lemma 13.51 the function w is nondecreasing, and so, the 
sequence (/i*) is necessarily increasing. Hence, h := lim„ ft* £ (0, m]. Again by 
Lemma l3.5l the function w is left-continuous on (0, m], and so, w(ft) = lim„ ) = 
lim n ti„ = u*. Thus, the claim that G V is checked. 

In view of Lemma 1331 and (|3.1.18|l . (x,u) £ Q implies that \x — r(x, u)| G V, 
whence, by (|3.3.13|l . for all (x,u) £ G, 

\x — r(x, u)\ ^ v <^=> \x — r(x, u)| ^ w*. 

Therefore and by virtue of l|3. 3.9(1 . the case when v £ (t>i, 1)2) for some v\ and D2 in 
V is reduced to case (II) v £ V . □ 

Proof of Ltmma \'3.13\ Lemma f3 . 1 21 implies 

EX 1{W £ (vi,v 2 ]} = EX I{W ^ v 2 } - EX I{W s? vi} = 

for any left-open interval (^1,^2] Q (0,oo). Thus, the countably additive function 
(c.a.f.) B 1— > EXIjH^ G 5} is zero on the semiring of such intervals. Since this 
semiring generates the entire Borel cr-algebra in (0, 00), this c.a.f. is zero on this 
cr-algebra. It remains to note that EXI{VF G {0}} = EXI{Vy 0} = 0, because 
W > a.s. and by Lemma EH □ 

Proof of Lemma \3.14\ For any set A C K, consider its pre-images under c and d: 

d~ 1 {A) :— {v £ V: d(v) £ A} and c~ 1 (A) := {v £ V: c(v) £ A}. 

Then, for any 8 £ (0, e], the sets 

C jtk := d-\(e sk ,e 5 ( k+ V]) n C - 1 ([-e 5(j+1) , -e 5j )) H B, 

where j and k run over all integers, form a partition of B which is both (d, e)-good 
and (c, e)-good (because, by Lemma 13.71 functions d and — c are (strictly) positive 
onV. 

It suffices to prove that this partition is also (/, £)-good, provided that 8 £ (0, e] 
is small enough. Toward that end, consider any one of the Cj^'s which are not 
null, so that 

(3.3.14) < d max (Q, fe ) < e s d min {C 3 , k ), 

by the construction of Cj^. 
Let 

(3.3.15) Si := (e e - l)mf{/(a:): \x\ ^ supB}. 

Then Si > 0, because the set B is assumed to be bounded and the function /, 
everywhere continuous and strictly positive. Then / is uniformly continuous on all 
bounded sets, so that there exists some 82 > such that 

(\x -y\^S 2 Sz \x\ < supB) =► \f{x) - f(y)\ ^ Si. 

Choose now S £ (0, e] to be small enough so that 

{e S - l)supS sC 8 2 . 
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Note that 

< dmin(Cj,fc) ^ rfmax(Cj,fe) ^ ^max(-B) ^ SUpB, 

by Lemma l3~7l Therefore and in view of (|3.3.14|1 . 

< dmax(Cj,fe) - dnuniCj.k) < (e 5 - l)d min (C jtk ) < (e 6 - l)sup_B < (5 2 , 
and so, 

,max(Cj,fc) ^ /r,min(Cj',fe) +^1^6 /r,min (Cj',fe) ; 

by the definition (|3 .3.1 5|) of <5i. Similarly, 

.max. 

□ 

Proof of Lemma VJ.15\ The case when C is a null set is trivial, because then each 
of the three terms in (|3.1.23|) is zero. 

Assume now that the set C is e-good. If (x,u) G Q + , then, by Lemma 13.31 
x = x+(h) for some h G (0, m); hence, by 13.1. 1911 . x = d(v) for v := w(h) = 
x - r(x,u). Therefore, if event {(X,U X ) G S+,W G C} occurs, then X = d(W), 
whence X G [d mm (C), d max (C)]. Similarly, if event {(X, Ux) G W G C} occurs, 
then X = c(W), whence X G [c m i n (C), c max (C)]. Also, if event {W G C} occurs, 
then I/O, because C C (0, oo), and X = implies W = 0. 

It follows that 

(3.3.16) {W G C} C {X G [d min , d max ] U [c min , c max ]} U E, 
where 

e~ {x^o,(x,u x )£g}, 

and we set, for brevity: 

dmin • d m i n (C), ^max ■ — d max (C), Cmin . C m j n (C), C max . — Cmax(C) . 

Note that, by Lemma f3. Ill 

(3.3.17) P(£) = 0. 

It follows from Lemma ESI (|3.3.16[) . and (|3.3.17(l that 

(3.3.18) = EX I{W G C} < 
where 

p := P(X G [rfmin, rfmax] , W G C), g := P{X G [c min , c max ] , W G C), 

so that 

(3.3.19) p + q=P{W EC). 
Similarly, 

(3.3.20) = EX I{W G C} ^ 
It follows from (|3.3.18|l and (|3.3.2l)[l that 

(3.3.21) — q^P^-: q- 

Next, letting 

fr,min - = /r^min^C)} /r,max " = /r,max .max ■ ,/t.max 
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one has 

(3.3.22) Ef(X) I{W G C} < f i<max q + f, 

(3.3.23) < -T—ifi 

.max u mm \ Jr.max • (-C m in)); 

here, inequality (|3.3.22|) is similar to l|3.3.18|) . and l|3.3.23|l follows from the second 
inequality in (|3.3.21|) . 

On the other hand, recalling (|2.11() and (|3.3.19|l . and then also using the first 
inequality in (|3. 3.21(1 . one obtains 

E<p f (W) 1{W eC}) fe ' min ' d ™ n + fr '™ n ' ( ~ Cmax) ( P + g) 

Cmin ~r ^max 

/^,min ' ^min ~t~ /r,min ' ( ^max) Q / , \ 

j 3 "3 \ ^max ~r ^maxj 



(3.3.24) = rir 2 r3—— (/^ )inax ■ d min + / r ,max ■ (-c m i n )), 

"min 



where 



^min .... _ F 

n ■■= - ^ e E , 



■-'max 1 "'max ^ 

r2 := _ c . +d — > e 



fl.min ' d m [ n + /r.min ' ( ^max) __ F ^min ~l~ ( c max) ^ — 2f 

r3 := 7 1 Tl TZ T ^ e a TTZ V ^ e ■ 

Now it follows from 13.3.24(1 and (|3.3.23j) that 

E<p f (W) 1{W eC}^ er i£ Ef{X) I{W e C*}, 

which proves the second inequality in 1(3. 1.23(1 . The first inequality in ((3.1.23(1 is 
proved quite similarly. □ 

Proof of Lemma \3.1b\ For j = l,...,n+l, introduce 

®j(xx,Vi,. . . ,Xj-X,Vj-XlVj,Vj + x, ...,v n ) 

(3.3.25) ( ) 

:= EF(xx,vx, ■ ■ .,Xj-x,Vj-i,DV',Vj, . . .,D { v n J,v n ) 

and 



(3.3.26) 



Xj := jf i+ P(Xi 6 dx,, G d«i)J |jj P(VK, G d«i) 

x$j(a;i,ui, . . .,Xj-x,Vj-x;Vj,v j+ x, . . .,«„). 



Then, for all j = 1, . . . , n, 

(3.3.27) Ij+i = y ^ ^JJ P(X t G da^Wi G d«i) j | f[ P(W t G d Wl ) J 8. 
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where 

£j := E$ j+ i(xi,vi, . . ,,Xj-i,Vj-i,Xj,Wj;vj+i, ■ ■ ■ ,v n ) 

= \ P(Wj edVj)E^ j+1 (xi,v 1 ,...,x j _i,v j _ 1 ,D^\v j ;v j+ i,...,v n ) 
Jr 

= [ P{W } G dvj) ( P(D% 6 da;,-) 

JR JR 

X + . . . ,Xj-i,Vj-i,Xj,Vj-,Vj + i, ...,v n ) 

= f P(W j e d Vj ) f P(£>g> e dx,) 

x EF(x! , v x , . . . , Xj, Vj, dV+V ,v j+ i,..., Dl n J , v n ) 

= f P(Wj ed Vj )EF(x u x j - 1 ,v j - 1 ,D®,v j ,...,DW, v n ) 

Jr 

= / P(W 3 E dvj) $j(xi,vi, . . . ,Xj-i,Vj-i;vj, . . . , v n ); 

JR 

the second of these 6 equalities follows by (|2.13|) , and the fourth and sixth ones by 

6333 - 

Now (|3.3.27|) and l|3.3.2tj|) imply that 

X $j(xt,Vi,. . .,Xj-l,Vj-i',Vj,Vj+t, . . .,v n ) 



for all j = 1, . . . , n. This finally implies = Zi, so that 
E J F(J5C 1 ,Wi,... ) X n ,W n )=X„ +1 



) W1 n(«) i 



□ 
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